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Abstract 

Gibbs distribution of binary Markov random fields on a sparse on average graph is con- 
sidered in this paper. The strong spatial mixing is proved under the condition that the 
'external field' is uniformly large or small. Such condition on 'external field' is meaningful 
in physics. 
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1. Introduction 

Strong spatial mixing property of Gibbs measures is very important in statistical 
physics. It roughly says that if there is a modification (or perturbation) on the 
boundary conditions, its influence to the Gibbs measure of a single vertex decays 
exponentially fast as the distance to the support of the perturbation (the set of 
vertices, whose spins are changed) becomes large. In the classic literatures, it is also 
required that the support of the perturbation has to be a single vertex [3]. Weitz 
considers the support of perturbation to be a set of vertices of arbitrary size. This 
generalized definition is equivalent to the one in [3] when the graph grows sub- 
exponentially (e.g. integer lattices). In fact, the definition by Weitz has much wider 
application. For example, it provides a natural algorithm to calculate the partition 
function of Gibbs measures if the strong spatial mixing holds [13j. In this paper, the 
definition of strong spatial mixing is in the sense of Weitz. 

Recently the strong spatial mixing is also studied through recursive formula. This 
approach is introduced by Weitz [13] and Bandyopadhyay, Gamarnik [I] for counting 
the number of independent sets and colorings. The key point of this method is 
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to build the strong spatial mixing on certain rooted trees. In [T3], the equivalence 
between the marginal probability of a vertex in a general graph G and that of the root 
of a tree for hard core model is proved using the self -avoiding tree technique. This 
shows the correlations on any graph decay at least as fast as its corresponding self- 
avoiding tree. The strong spatial mixing for hard-core model on bounded degree trees 
is also proved. Later Gamarnik et.al.[5] and Bayati et.al.[2] bypass the construction 
of a self-avoiding tree. Instead, they create a computation tree and establish the 
strong spatial mixing on the corresponding computation tree for list coloring and 
matching problems. Considering the Weitz's motivation of construction of the self- 
avoiding tree, Jung and Shah[6] and Nair and Tetali generalize Weitz's work 
to certain Markov random fields models, and Lu et.al.[8] on TP decoding problem. 
Very recently Mossel and Sly[IU] show that ferromagnetic Ising model exhibits strong 
correlation decay on 'sparse on average' graph under the tight assumption. 

We consider the Binary Markov random fields, which are also known as two state 
spin systems, on a sparse on average graph where the total degrees along each self- 
avoiding path (a path with distinct vertices) with length O(logn) is O(logn) [10] . 
We prove, for any 'inverse temperature' on this graph, Gibbs distribution exhibits 
strong spatial mixing when the 'external field' is uniformly larger than B(d, a max , 7) 
or smaller than — B(d, — a m ; n , 7). Here, d is 'maximum average degree' and ami n , 
Omax) 7 are parameters of the system. To the best of our knowledge, this condition 
on 'external field' is first considered for strong spatial mixing. Our proof is based 
on a well known recursive formula [6] on a tree and the self-avoiding tree technique. 
We also employed Lipchitz method, which was used in [UEIH]. The novelty of our 
proof is that we propose a 'path' characterization of Lipchitz method, which enables 
us to give the 'external field' condition in terms of 'maximum average degree' for 
the strong spatial mixing. 

The remainder of the paper has the following structure. In Section 2, we present 
some preliminary definitions and notations. We go on to propose the main result in 
Section 3. Section 4 is devoted to prove the main theorem. Conclusion and further 
work are given in Section 5. 

2. Preliminaries 

Let G = (V, E) be a finite graph with vertices V = {1, 2, • • • ,n} and edge set 
E, and let d(u, v) denote the distance between u and v, for any u, v £ V. A path 
Vi, V2, ■ ■ ■ is called a self-avoiding path if ^ Vj for any i ^ j. The distance between 
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a vertex v G V and a subset A C V is defined as 

d(u,A) = mm{d(v,u) : u G A}. 

A set of vertices with distance I to the vertex v is denoted by 

S(G,v,l) = {u : d(v,u) = I}. 

Let 8 V denote the degree of the vertex v G G. The maximal path density of the 
graph G is given by 

m = m(G, v, I) = max S u , 

where the maximum is taken over all self-avoiding paths T starting at v with length 
at most /. The maximum average path degree S(G,v,l) is defined by 

5(G,v,l) = (m(G,v,l) -5 v )/l, 1>1. 

The maximum average degree of G is defined as 

A(G,0 =max8(G,v,l). 

For any order of all the vertices in G given, an associated partial order of E based on 
the order of V defined as > (k, I) if and only if and (A;, I) share a common 
vertex and i + j > k + l. In binary Markov random fields(BMRF) on G, each vertex 
i G V is associated with a random variable with range Q = {±l}(briefly ±). 

Definition 1. The Gibbs measure of BMRF on G is defined by the joint dis- 
tribution of the random variable X = {X±,X2, • • • , X n } 

P G (X = a) = — — exp( foj( a ii a i) + Yl ^(^))' 
1 J (i,j)eE i&V 

where hi : Q — > R and : Q 2 — > i?. Here Z(G) is called the partition function of 
the system. 

Note that the Gibbs measure would satisfy YlaeQ" Pg(X = a) = 1. We use 
notation Pij(a, b) = (3ji(b, a). For any A C V, a\ denotes the set {cij, i G A}. With a 
little abuse of notation, a\ also denotes the condition or configuration that i is fixed 
<jj, for any i G A. Let Z(G, $) denote the partition function under the condition 
e.g. Z(G, X\ = +) represent the partition function under the condition the vertex 
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Figure 1: The graph with one vertex assigned + (Right) and its corresponding self-avoiding 
tree T SQU , (1) (Left) 

1 is fixed +. 

A self-avoiding walk (SAW) is a sequence of moves (on a graph) which does 
not visit the same point more than once. The following gives an important tool in 
proving our results. It is introduced in [13]. 

Definition 2. (Self- Avoiding Tree) The self-avoiding tree T saw ^(G) (for simplicity 
denoted by T saw r v )) corresponding to the vertex v of G is the tree with root v and 
generated through the self-avoiding walks originating at v. A vertex closing a cycle 
is included as a leaf of the tree and is assigned to be +, if the edge ending the cycle 
is larger than the edge starting the cycle, and — otherwise. 

Remark: Given any configuration a\ of G, A C V, the self-avoiding tree is con- 
structed the same as the above procedure except that, the vertex which is a copy 
of the vertex i in A is fixed to the same spin cr, as i and the subtree below it is not 
constructed due to the Markov property, see Figure 1 for example, where vertex 5 
is fixed + in G. 

To generalize the strong spatial mixing property on trees to general graph, we 
need to utilize the remarkable property of the self-avoiding tree, one of two main 
results of [13], and explicitly stated in [6]. For any configuration a a of G, A C V, 
we also use <ta to denote the configuration of T saw r v -\ obtained by imposing the con- 
dition corresponding to a\. 
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Proposition 1. For BMRF on G = (V, E), for any configuration a A on G, A C V 
and any vertex v G V , then 

P G (X V = +\a A ) = P Tsaw{v) (X v = +|a A ). 



In order to study results to the sparse on average graph, their following proper- 
ties are useful. The proof is based on induction and can be found in [10J. 

Proposition 2. Let j, I be positive integers. Then one has 
m(G, v,jl) < j max{m(G, u, I) — 5 U } + S v 

and 

\S(T saw(v) ,v,l + l)\<5 v (5(G,v,l)-l) 1 . 



Definition 3. (Strong Spatial Mixing) The Gibbs distribution of BMRF exhibits 
strong spatial mixing if and only if there exist positive numbers a, b, c independent 
of n, for any vertex v £ V, subset Ac^, any two configurations a\ and rj\ on A, de- 
note perturbation set G = {v € A : a v ^ r/ v } and t = d(v, Q), when t = kalogn + 1, 
fc = l,2,..., 

\P G (X V = +\a A ) - P G (X V = +\ VA )\ < f(t), 
where decay function fit) = bexp(-ct). 

3. Main Results 

In the binary Markov random fields, it is well known that if /3ij(o~i, o~j) = JijGiGj 
and hi = F>iO~i for all the edge € E and vertex i S V, and Jij is uniformly 

positive (or negative) for all (i,j) £ E, the BMRF is called ferromagnetic (or anti- 
ferromagnetic) Ising model. For simplicity, we use the following notations. Let 

T _ +) + ~) ~ +) ~ Mb ~) 

J ij ~ 4 

and Bi = M+lzjiiz) f or a n edges and vertices . We call and 'inverse tem- 
perature' and 'external field' of BMRF. Let J = max(j^ e g \ Jij\i B min = mm i& y B i: 
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and -B max = maxj g y B t . Denote 



and 



a max = max {/%(-,-) - /% (+, -), /%(-, +) - /%(+,+)} 



a min = min {/%(-, -) - /%(+, -)>/%(->+) ~ ftj (+>+)}■ 



Let 

c\bijCij ^2 7 d{ j I I ^ 7 Q 7 &i 7 ^ 7 I 

jij = max { — - — — — , — - — - — - — - — — }, 

(ij')e-E a-ijCij bijdij 

and 7 = max( ij ) e£; {7y}, where 

aij = exp(/%(+, +)), bij = exp(/%(+, -)), 
Cij = exp((3ij (-,+)), dij = exp(/3ij(-,-)). 



Theorem 1. Lei G = (V,E) be a graph with n vertices. There exit two posi- 
tive numbers a > and d > such that A(G, alogn) < d, and (d — l)tanh J > 1. 
Assume 

7) or fi max < -B(d, -a min ,7) 

w/iere 



a, 7) = + log(-* j- ). 

Then the Gibbs distribution of BMRF exhibits exponential strong spatial mixing. 

Remark: In Theorem 1, by the definition of 7™, one has 

7 ?. > \{hl - ^iL\(2iL - = ( e 2 ^ _ e" 2 ^) 2 , 

hence, 

Hj > \e 2Jii - e~ 2Jij \ = (e Jii + e~ Jij ) 2 tanh J„ > 4tanh Jjj. 

Therefore, 7(d — 1) — 4 > under the condition (ci — 1) tanh J > 1 . The case of 
{d — 1) tanh J < 1 is discussed separately in |14j with totally different method. The 
decay function corresponding to the above two conditions are respectively 

f(t\ - Sa ( - 1 ^ >7 ex P( 2B mm ~ (d- l)a ma x) w_l 

U ~ 4 1 (l + exp(2£ min -(d-l)a max )) 2 ) 

and 

f(t) - ^7 / (d ~ 1)7 exp(2ff max - (d - l)a min ) t _ ± 
f[) ~ 4 1 (1 + exp(2£ max - (d - l)a min )) 2 ' 
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4. Proofs 

Theorem 1 is proved with the recursive formula[6j. The technique used is Lipchitz 
method, which is well known. A 'path' version of it is presented first. We use the 
following notations for simplicity. Let T = (V, E) be a tree rooted at with vertices 
V = {0, 1, 2, • • • , n}, edge set E and BMRF on it. For each edge G E, recall 
the notation in Theorem 1, 

= eP* (+•+), b itj = e^M+'-O, cy = (">+), and = e^M" '->. 
Let Mjj = Cij — dij and JVy = Oj j — Define 

fa( x ) = — nr^ and Nj'W " 



Nijx + bij (Mijx + dij) (Nijx + bij) 



For any z € V, let Tj denote the subtree rooted at i and there is a associated BMRF 
on Tj restricted by BMRF on T. Recall J3i = M±lzMz) i s t he external field. De- 
note Aj = e _2Bi , and let be the unique self-avoiding path from i to j on T. 



Lemma 1. For any € E, max |/tij(x)| < Jij- 

xe[o,i] 

Proof. Since M^x + dij > and NijX + 6^ > 0, Vx € [0,1], thus all we need 
is to show 

min w(x) = mm(aijCij,bijdij), 
xe[o,i] 

where w(x) = [MijX + dij)(NijX + bij). The case MijNij = is trivial. Hence 
without loss of generality, suppose MijNij ^ 0. Noting xi = — rf ' J ^ + ^ M ' J is an 
extremum of on i?. There are three cases needed to be discussed. 
Case 1. MijNij < 0, then w(x) reaches its minimum at boundary. Then min w(x) < 

x£[0,l] 

min(w(0),io(l)) = mhuji ;,<■;,. I>;,<l;,). 

Case 2. Mj ? - > 0, iVj,- > 0, then x\ < 0, w(x) is increasing on [0, 11, then min w(x) = 

xe[o,i] 

w(0) = ftijdjj. 

Case 3. My < 0, iVjj < 0, then > 1, w(x) is decreasing on [0,1], hence 
min w(x) = w(l) = ciijCij. □ 

x£[0,l] 

With Lemma 1, we present a 'path' version of Lipchitz approach. 
Lemma 2. Let A C V , Ca and VA be any two configurations on A. Let = 



7 



{i : Q + rji, i G A} ; t = d(0, 0) and S(T, 0, t) = {i : d(0, i)=t,ie T}. Then 

\P T (X = +|Ca) - Pt(^o = +MI 

fce5(T,o,t)ier 0fc 

where Zi are constant vectors with elements in [0, 1], and gi{xi) = (1+Aj ] { fujixuj)) -1 , 

(i,ij)€Ti 

Proof. For any vertex i in T, recall Tj denote the subtree rooted at i with BMRF 
induced on T, by T. Let pj A = P Tl {X % = +|CaJ and = ^^=-|aj ' where ^ 
is configuration by restriction of (a on Tj. Let denote the configuration space 
in Tj under the condition (a, * = 1, 2, • • • , n. denotes the configuration space of 
To under the condition £a U {ctq}. Let 0i, O2, • • ■ , q be the neighbors connected to 
0, q = <5o(the degree of the root). Now we present the recursive formula, 



r: 



Ca = z ( T 0i X = +iCa) 
Z(T , X = -, Ca) 

E(A>o i (+,o-o i )+ E /3fei(o-fc,o"i)+ E h kWk)) 

e M+) e l=1 (W)eT . fcST . 

E(/ ? OO i (-,o-o i )+ E /3fci(o-fc,oi)+ E M CT fc)) 
e M~) e l=1 (M)eT . fc £ T . 

/9oo i (+,<ro i )+ E /3fei(o-fc,o-i)+ E h fc (<7 fc ) 

y> g (W)ST 0j fe£T . 
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e 2B « J] 



T <>, 



/3oo i (-,o"0j)+ E /3fei(o"fc.o"i)+ E h k{°k) 
1=1 g (W)eT . feeT„. 

1 = 1 coo^^,^ = +, CaJ + d 00l Z(T 0t ,X t = - CaJ 
i=l COOi-Rot + ^oo, 
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Then we have the following equality 



^ A = P T (X = +|Ca) 
1 



1 

i + Ao n J l+ h 

1 

i + ao n 



= go(xo), 

where xq = (Pq^,Pq^, • • • ,Pq^ )• First, note that for any x = (x±,X2,-- - ,x q ) and 
V = (2/1)2/2) •" " >2/g)> fi rs t order Taylor expansion at y gives that there exists a 6 € 
[0, 1] such that 

3o(z) - g (y) = Vg (y + 9(x - y)){x - y) T , 

where (x — y) T denotes the transportation of the vector (x — y). Careful calculations 
give the following 

Aoll/oo 3 (^')( ^ J 

030(2;) _. j=i 



U + Aon/oo^)) 2 



= -flo(a;)(l -3oW)( 
= go(x)(l -go(x)) 



M 00l N 00i 



Moo^i + d 00i N 00i xi + b 00t 

000,^00, - ^OOiCQOi 



(Mo 0l Xi + doOiX-NoOiZi + & 00 .) 
= 3o(«)(l - 3o(z))fy)o i E «)- 

Hence, let x = (Poi.Poa'"' 'Po,,,) and ^0 = (Po^.Poa'"' '^o A () )' then there exits 
6 G [0, 1] such that 



IpS 4 -J^l < X>(*b)(l -3o(^o))V(^)lb& -<l 
J'=l 

< ^ 5 o(^o)(l - 3o(^o))7oo,|pg -PT 3 \ (1) 
<7E3o(^o)(l-3o(^o))^ A -^ 



3=1 
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where zq = xq + (xq — yo) and the second inequality follows by Lemma 1. Now 
repeat the procedure on the subtree Tq. for — p^\, J = 1, 2, • • • ,q and so on. We 
can see that the summation is over all the self-avoiding paths starting at the root 
0. For each path F, if the end point of T is a leave j with d(0,j) < t — 1 or there is 
a vertex i on T with d(0, i) < t — 1 being fixed, the contribution of the path to the 
summation is zero since p\ A — pf K = p^ A — pJ A = 0. Hence the remaining path with 
length t is in the set {Tofc : k G S(T, 0, t)}. This completes the proof of lemma 2. □ 

In order to complete the proof of Theorem 1, we need the following lemma. 

Lemma 3. Let Aj > 0, i = 1, 2, ■ ■ ■ , n. Then 

n 

U(i + x l )>(i + 



v n*) n - 

\ i=i 



Proof. Consider 



n n k 

ri(i+A,)=i+E( e n a 

i=l k=l ii<i2<---<ifc 3=1 

C n-\ 

>l + E( C n(IT^) °" ) 

k=l i=l 

n n 

= l + E( C 'n(II A *)-) 



k=l i=l 



(1 + 



> i=i 



where = k \^Lk)\ ■ ^ ne ^ rs ^ inequality uses the arithmetic-geometric average in- 
equality. 



With Lemma 2 and 3, it is sufficient to prove Theorem 1. 

Proof of Theorem 1. Following the notation of Lemma 2, let s = \S(T,0,i)\, 
we have 
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|^ A -^ A |<7* £ II 9i(zi)(l - 9i(zi)) 
keS(r,o,t) ier ok 

< S7* max V] 9i(zi){l - gi{zi)) 
keS(T,o,t) f A 

7* TT 

- S T (0 ™T H 9i{zi){l-9i(zi)). 

ke 's(T,o,t) ie ^ fe 



For each T 0:jk , where (0, 0j) € T, fc e S(T, 0, t), 

n fi(^)(i -9i{zi)) 

*er 0j fe 



•^i II fiii{ z iii) 
(i,ii)eTj 

, (1 + A, n finizin)) 2 



n a 



where rjfc = ( [f Aj j [ fu l (^mJ) 1 ^' -1 ^ and the inequality above follows from 

ieT 0jk i^k (i,ii)€Ti 

Lemma 3. A simple calculation gives that e° min < fij(x) < e amax , for any £ T. 
Hence, 

e a min (5(T,0,t-l)-l) < ( TJ TJ y..^..j)l/(t-l) < e a max (5(T,0,t-l)-l)_ 

ieT 0jk (i,ii)eTi 
i+k 

Now we prove the exponential strong spatial mixing under assumption of Theorem 
1. Suppose r is a self-avoiding path of G. Noting that each self-avoiding path on T 
by removing the ending point is also a self-avoiding path on G. From proposition 
1, we know is a vertex of G and let Pq A = Pg(Xq = +|Ca)- By proposition 2, 
we know 6{T,0,t - 1) < A(G, t - 1) < d when t = kalogn + 1, k = 1, 2, • • • . If 
B min > B(d,a max ,~f), then 

7(rf - 1) exp(2ff min - a m ax(d - 1)) 1 
(1 + exp(2 J B min 

By proposition 2, we know s < 5 (d — l)* -1 . Noting ( n Aj) 1 ^*" 1 ) < e ~ 2Binin , 

ier . k 
i^k 
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now we can see 

IPo 1-lPo Po I <s 4 ( (1 + r ^ )2 j 

< <5q7 / 7(^ - l)exp(2ff min - a max ((i - jOK t-i 
" 4 1 (l + exp(25 min -a max (d-l))) 2 J ' 

where the first equality follows from the proposition 1. The similar case holds for 
-Bmax < —B(d, — a m i n ,7). This completes the proof. □ 

From the proof above, we can see if the graph is bounded degree with maximum 
degree is d, the condition for 'external field' can be relaxed to Bi > B(d, a max , 7) or 
Bi < —B(d, — a m in,7) for any i G V, which does not require that 'external field' is 
uniformly large or uniformly small as in Theorem 1. 

Corollary 1. Let G = (V, E) be a bounded graph and with maximum degree d and 
BMRF on it, and tanh J(d— 1) > 1. If B i > B(d, a max , 7) or Bi < —B(d, — a m in, 7) 
for any i £ V. Then the Gibbs distribution exhibits strong spatial mixing. 

Proof. Following the notations above, by the formula (1) in Lemma 2, we have 

\p c a -pT\ < 7 i>(«>)(i - sb(*b))|j# - 

Without loss of generality, suppose the degree of is d — 1. Then 

|^ A -P V A \ < 7 (d- l)max( 50 (^)(l " St>(*)))|j# ~P%\- 

If B { > S(d,a max ,7) or Bi < -B(d, -a min , 7), we know ^{d-l)gi{zi){l-gi{zi)) < 1 
for any % G T. Hence by induction on the hight t, we get 

\p C A -PT\< (l{d - 1) maxGfoteXl - 9o(zi)))Y. 
Since the degree of is at most d. Then 

|^ A - pT\ < ldg Q (z ){l - g (z m(d - 1) max( 5o (^)(l - So^))))*" 1 
< ^( 7 (d - 1) max( 50 (^)(l - goizi))))*- 1 . 
Applying proposition 1 completes the proof. □ 
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external field 

Figure 2: The red line and the blue line denote the "external field" curves for uniqueness 
of Gibbs measures and for strong spatial mixing on three regular trees T respectively, where 
(3ij(ai, Oj) — JoiOj and hi{pi) = Bat, for any i € T and G T. 

Remark: We emphasize that the tighter bound of fijix) is the key to improve 
the result since better bound of fij(x) will give better bound for gi(x). We do not 
optimize the parameter here. We are not aware that Lipchitz method can make 
B{d 

jC^maxiT) or —B(d, — <y m [ n , 7) optimally approximate the critical point of 'exter- 
nal field' for uniqueness of Gibbs measures if they does exit. Note that the critical 
points of 'external field' for ferromagnetic and antiferromagnetic Ising model are 
different on an infinite d regular tree with degree d for each vertex [4]). We do not 
expect the critical external field for Ising model on d regular tree for uniqueness of 
Gibbs measures is the optimal external field for strong spatial mixing. The intuition 
for this is that the uniqueness of Gibbs measures on the tree is equivalent to weak 
spatial mixing (see [3] [13] for definitions) in some sense 0. If some configurations are 
close to the root(note some configurations may be at the hight 2 or 3(see Figure 1) 
when self-avoiding tree is constructed), the perturbation of the boundary condition 
changes the Gibbs measures at the root radically. More precisely, strong spatial 
mixing can be deducted to the weak spatial mixing by removing the support of 
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unmodified boundary configuration and changing the external field of some vertices 
(see Lemma 2 in [14]). Hence, the critical external field condition for weak spatial 
mixing does not hold for strong spatial mixing. Figure 2 illustrates the curve of 
external field under our condition for strong spatial mixing and the critical external 
field for uniqueness of Gibbs measures on infinite d regular tree, where d = 3. 

5. Conclusion and Further Work 

The Gibbs distribution on a graph G = (V, E) with 'maximum average degree' 
d is considered in this paper. The (exponential) strong spatial mixing is proved for 
such systems, when the 'external field' B{ is uniformly larger than £>((i, a max , 7) or 
smaller than —B(d, — a m in>7)- Here B(d, a, 7) is a function with parameter d, a, 7. 
It is not difficult to apply our results to Erdd-Renyi random graph G(n, d/n), where 
each edge is chosen independently with probability rf/re[T0j. 

For future work, some improvements to the condition on 'external field' should be 
possible. We have emphasized the essential key points in the remark of last section. 
However, we believe that it requires other method other than Lipchitz method. The 
fixed point method in[7] may be a possible approach. 
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